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STATIONARITY CONDITIONS: EOR 
STOCHASTIC DIFFERENTIAL EQUATIONS. 

I 1 ; 

This is a preliminary study o;f. pos.s±b-Ie; necessary and- 
sufficient conditious to insure s^tatLonaxiity ‘ in; the- solution:, 
process for a stochastic dif ferentiai equavtion . . I.t: indirectly 
sheds some light on ergodicity properties- and' shows.- that : the. - 
spectral density is generally inardequate:- an' a- s;tatis.ticall 
measure of the solution.. Further' wark: in pro;ceedingr on- a?. 
more general theorem which g.iv.es? nece-ss?a-ry and', s.ufficient-: 
conditions in a form useful fan a-p.p:Iircationss. 
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SECTION 1 


The following definitions and notation will be used 
consistently throughout, this thesis. 

will be. a- fixed (but otherwise arbitrary) 
probability space wi.th. points u 6_n, a o-algebra J of 
subsets (probabilizable events), and a complete measure 
IX such that = 1. 

A random variable (r.v.) x;==x(oi) will be a finite 
real— valued (or complex. valued) measurable function defined 
on ft,, we require: that. [ut:x(ai) < X} 6 7 for ill real 

numbers X. If x(co) is complex-valued, we require that 
x.(vtti) = uCui) + ±v.(,ui) where, u. and:.v are real-valued r.v. ’s. 

Given a r.v. x('oi, E(x) or. <x> denotes the integral 

J , x(cii) d^(cu) if this, integral is defined. 

Ct 

Given a parameter, set T. (which wo usually take to be 
the real numbers), a stochastic process (s.p.) or random 
function (r.f.) on T is a real or complex-valued function 
X:Txft — R(C) such that for each fixed t €T the function 
x^(oi) = X(t,ui) is a r.v. Very often in our notation we 
will suppress the variable co and write X(t) for the r.f. 
Notice that a s.p. has two convenient interpretations. 

First of all, a s.p. is a- family of r.v. 's Indexed by T, 

X •= [x^(oi):** — Oh. the other hand, if we 
emphasize the variable t and let T = R, then a s.p. X is a 


2 


collection of real-valued functions of a real variable 
(indexed by r.) . These functions are called the sample 
paths (realizations, trajectories) of the process. The: 
measurability of X with respect to the variable oe says 
nothing about measurability with respect to the t,. and in 
general the sample paths may be very badly behaved. How- 
ever, we will consider only measurable processes,. 
functions X(t,tc) which are measurable with respect to 
'the o-algebra JxJ where is the family of Lebesgue 
measurable subsets of the real line. Then all, the sample.- 

paths will be measurable. 

2 

We let L (r.) denote the Hilbert space of all square 
integrable r.v.'s on making the usual identification. o± 
r.v. 's which are equal almost everywhere with, respect to 
the measure 

We say that a r.f. X(t,a) is second order if each 

2 

r. v. x^, t€T, is a member of L (ft). Thus X is second 
order if and only if Jj.jx(t,oc) 1 dM(a-') < ® for all t 6 T\ 

Note that a second order r.f. X induces a map into a 
space of r.v.'s Y;T — L^(r.) defined by (Y (t) ) ( u') = X (t , oj) . 
The covariance function associated with the r.f. X is de- 

. II,— , - - I 

fined by T (s,t) = E(X(s)xJTY) . 

A 

Once again let T = R and let X(t,o:) be a second order 

s. p. Let Y be defined as in the preceeding paragraph. 

We say that X is continuous in the mean square sense at. t^ 

if l.i.m. X(t) = X(t,~). This is equivalent to saying, that, 

t-to ° 

the function Y(t) is continuous at t^ relative to the 
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standard topology on the reals and the norm topology on 
2 

L. (fl) .. Similarly, we say that X(t) is differentiable in 

mean square at t^ if there is a r.v. (second order) r 

such that l.i.m. ^^^0^ = r; Thus X is differentiable 

in. mean square at t^ if and only if Y(t) is differentiable 

at tg-, a-nd moreover r = same analogy carries 

over, to integration (Riemann, Riemann-Stieltjes, Lebesgue- 

type) in. mean square of X and the corresponding integration 

of Y.. Hence, the study of. the mean square analytic properties 

of^ a- (sec:and-order ) s.p. X is' equivalent to the study of the 

2 

(tor.res:ponding properties of. a function Y:R — L (ft). 

Tihroughout this thes'is we- will . deal with the concept 
of wide-sense stationarity . Moreover, without loss of 
generality we consider only zero-mean processes, and con- 
sequentLy we; take as the: defining characteristic of a 
stationary process X the existence of a correlation function 
f such, that r^(s,t) = f(t-s). We define the spectral 
dens>i.t.y. function of the process by <p(u) = Je^^^^^f (t)dt . ^ 


We use this definition of correlation function in 
accordance with Adomian [1]. Often in the lit erat ure the 
correlation function is defined g(s-t) =E(X(s)X(t)) which 
Is the complex conjugate of our definition. We let 

^(u) = (t)dt be the spectral density function of 

the process, whereas some authors.may have ^(u) = Je ^^^^^f'(t)dt 

as the. spectral density function. This of course will be 
the complex conjugate of our spectral density function. 


4. .j 
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I 

Usually we consider only real processes, however if some t 

result takes on a much cleaner form in the complex case 

i 

f 

we will note it. i 

j 

The physical interpretation of stationarity is well | 

, . t 

known (see Yaglom [11]). The following geometrical » 

i 

interpretation may provide some insight however.. No.te that ! 

• i 

a second-order process with the feal line as. the parameter I 

! 

set is a map X:R — L^(rO from the reals into a particular 
Hilbert space. Hence the relationship E(X(s)X(t)) = f (t-s) 
is merely a restriction on the behavior of the inner pro- 
ducts of points in L (fl) which lie on the curve associated 
with X. In particular, ||X(t)|l^ = E(X(t )xTt )): = f((t— t:)' = t(Q); 
for all t, and so the curve X must lie on a sphere of radius 
f(0) centered at the origin. For stationary X,. 

E(X(s + T)X(t+T)) = E(X(s)xTty) for all s, t, and r,. and so 
if we think of the inner product as determining an. angle 
between say the vectors X(s) and X(t), then this angle is 
invariant under translations of the parameter set, e.£., 
the angle between X(s) and X(t) is the same as the one 
between X(0) and X(t-s), A circle in R centered at the 
origin is an example of such a curve if the standard para- 
meterization is taken: thus, consider the curve 

x(t) = e^ cos t + e 2 sin t where e^^ and eg are the standard 

2 

basis vectors for R . In general, we can. replace, the unit. 

2 

vectors by arbitrary orthogonal vectors in L (fJ) of equal 
norm, call two such (distinct) vectors A and B., Then, the 
process defined by X(t) = A cos t + B sin t is really just 
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a circle in L (C), and a simple calculation shows it. is 

stationary. One of the most powerful results in the 

general theory of stationary processes is that every 

(continuous) Stationary process is the limit of sums of 

processes of this special type. 

One is naturally interested in determining what, sort 

of transformations of stochastic processes preserve Srtatton— 

arity. For the moment, we interpret the term, "stochastic 

transformation" in the loosest sense, namely we call any 

rule which associates one or more processes- with another' 

2 

process a stochastic transformation (s.,t..); .. In this- 
sense there are many s.t.'s which; carry stationary pro- 
cesses into stationary processes,, and we list here; just, a. 
f ew; 

i) Let U:L^(n) — > L^(R) be any isometry.. Let. 

F(t) be a stationary process. Then the process 

G(t) = U(F(t)) is stationary since E(G(s)G(t) ) = E(F(s)F(t) ) = 

f(t-s). Let a be any complex number. Then the process 

H(t) = aU(F(t)) is stationa,ry since E(H(s)H(t) ) = jal^f(t-s). 

ii) Let F(t) and G(t) be stationary processes such 
that the smallest closed linear manifolds containing F and- 
G respectively are orthogonal. Then F(t) + G(t) is a. 

— 2 

For a more complete discussion of this term, see' 

Section 4. One also may wish to consider the possibility 
of mapping a random function into a random sequence. In 
his dissertation Adomian presented and discussed the 
important example of a randomly sampled random function. 

He also sets up conditions under which, a stationary random 
function is mapped in this manner into a stationary random 
sequence. 
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stationary process since E([F(s)+G(s) ][F(t)+G(t) ]) 

= f(t-s) + g(t-s) = u(t-s) where u = f+g. Note that in 

general the sum of two stationary processes is not stration-^ 

ary. A necessary and sufficient condition that. F(t) + G(t) 

be stationary is that E(G(s)F(tV) + E(F(s)G(t) ) be a 

function of t-s, and we see that this is a fairly strong 

restriction. The fact that stationary processes da not. 

form a linear manifold (in the space of all processes) 

causes a certain amount of difficulty in determining what 

s.t.'s preserve statipnarity . 

iii) Let the stationary process F(t) be n times? 

continuously differentiable and let ..c be constants . . 

O n. 

" (k) 

Then the s.p. G(t) = L c.F (t) is stationary and 

k=0 ^ 

E(G(s)G(t)) - E c^c. (-1)^ f Ct-s),.. We not& that 

k.j-0 J 

limits (in mean square) of stationary processes need not be 

stationary, and so it is unusual that linear combinations. 

of derivatives of stationary processes are stationary. As 

s 

a rule, the function G(s) = + J F(t)dt is not stationary 

^ O 

even though F is, and so integral operators do not in general 
preserve stationarity . Intuitively the solution to a 
stochastic differential equation is representable in the 
form of applying a stochastic integral operator to the 
-forcing function of the differential equation; thus we. see 
this operation will not often yie^ld as a stationary solution.. 
We now seek to determine conditions under which stochastic 
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differential equations do possess stationary solutions. 
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SECTION 2 

This section is devoted to the study of analytic ran- 
dom functions and their application to stochastic dif- 
ferential equations. We recall t;^at if X(t) is a second 

order random function, then X(t) can be thought of as a 
2 

map X:T — L (Cl). Usually T will be the set of real n\im— 
bers or some subset of the reals; more generally, T will be 
a subset of a Euclidean space. There is already a general 
theory of analytic maps from finite dimensional Euclidean, 
spaces into Banach spaces, so we list here, only the; most: 
relevant parts of this theory. 

Definition: Let B be a real Banach space.. Let [c; }” „ 

n. n?=u. 

-be a sequence of elements of B. Suppose there is a positive 
real number r such that the series L l|c^l|t*' converges for 
all real numbers t satisfying jt | < r. Then the series 
£ c^t^ is called a power series centered at 0 with coeffi - 
cients in B. 

Notice that since a power series converges absolutely (by 
definition) in the space B and since B is complete, the 
series does indeed converge to an element of B tor each 
appropriate t. The absolute convergence of power series 
allows us to rearrange the series however we- like,, andl the 


i 


9 


rearranged series will still converge to the same limit. 

Theorem 1 . Suppose L a^t*' and L b^t” are two power series 
for 1 1 1 < r with coefficients in ^ Banach space B. ^ 

L A t"^ = E b t"^ for all t € (-r,r), then a_= b_ for each n. 

We will find this theorem on uniqueness of coefficients 
especially useful. For a proof , *see Dieudonne [ 31 ].. 

Definition . Suppose f is a function from- the; reals.-, into a 
Banach space B. Suppose there are elements. in B 

such that f(t) = E(C^/n.'.) t*^ for jtl < r. Then f; is: said 
to be analytic at O. 

In accordance with this definition,, a second: order- random 

function X(t) is analytic at O (in. the mean, square: sense) 

when there are second order random variables' X q, , .. . 

such that X(t) = E(X^/n!)t” for l,t 1 <' r., lif: we.^ include the: 

dependence on Cl in our notation, we see that X(t,<*;) = 

E(X (u.)t'^)/n.' and so an analytic random function is one 
n 

which has this special sort of separation, of. variables. 

We have the following theorem which relates analyti- 
city of a random function to the analyticity of its co- 
variance function. 

Theorem 2 . A second order random function X(t) . is analytic 
if and only if its covariance function (s , t ) is' analytic 
at every diagonal point ( t ,. t ) .. this condition is 
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satisfied , then Fj^Cs.t) analytic at each . (s,t). 

More simply, a random function is analytic if and only if 
its covariance function is analytic. See Loeve [7] for a 
proof of Theorem 2. 

Returning to more general Banach space considerations, 
we have the following very important theorem, again from 
Dieudonne , 

Theorem 3 . Suppose f:R — > B, B a Banach space , is analytic 
at 0. Let f(t) = E(C^/n.' ) t*'. Then f is infinitely differen- 
tiable . Moreover , f^^^(t) = Z )),. f^^^('t); is 

n=0 

analytic , and f^^^(O) = C^. 

Hence we see that the random variables occurring in. a power.' . 
series expansion of a random function are related in a 
simple way to the mean-square derivatives of the random 
function. 

Let us now turn our attention to the question of 
forming a product of two elements each from a (perhaps 
different) Banach space. We are motivated by ordinary 
differential equations of the form x' (t) + a(t)x(t) = f(t) 
but we would like to replace the functions involved in 
the equation by second order stochastic processes. Then 
wewould have an equation X'(t) + A(t)X(t) = F(t) where 
X, A, and F are maps from the reals into the Banach spacez 
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2 

L (Ti ) . There is a natural way of attaching meaning to the 

formal product A(t)X(t), we can form the pointwise product 

fA(t)X(t) ] (cc) = A(t, odX(t, oi) . In general, this expression 

2 

no- longer defines a function into the space L (D since 
A.(t, u3)X(t, 0 .') may not. be. square integrable (with respect 
to ou) for each t. Consequently, some care is needed in 
handing these product si. * 

Consider.' now the general- case of forming products in 
Banach spaces. 

Definition .. Let Eland F be: two' (real) Banach spaces. A 
map. Pt.E X E — >> El is? called . a:. product on the spaces E and 
F if P is. bilinear and. satisfies." the inequality 
l|PC.e,,f)|l C llejl llfll for. every e;€ E and f €F. 

We: usually wri.te: ef: for the: product P(e, f) . There are many 
examples of products, and the one which we will find useful 
is the following. 

Let E be a Banach space, let F = L(£, E) be the space of 
bounded linear operators on E. Note that F is a Banach 
space. Define the. product P: E x F — > E by P(x,f) = f(x). 

It is elementary to verify that P defines a product in our 
sense. 

We prove now a- few generalizations of well-known 
theorems and see how they fit into our more general framework. 
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Theorem 4 . Suppose P: E x F — > E ^ at product . Let 
A = ^ ® and B = ^ F two absolutely convergent 

n n 

series. Define C =- L a .b. =- L P(a .,b.). Then 

j=o J j=o J 

L; C = AB =- P(A,B) . 

n. ; 

% 

We can prove this theorem by sligljtly modifying the proof 
for' the- case;- E- = F/ - R' found; in Rudin [9] so we omit the 
proof here. However, as an important corollary we have: 

Let A; I — > L.(E,E) and x: I — > E; be . two functions defined 
on'. I,, an. o,pe.n- interval- containing O. If A and X are both 
analytic: at: 0.,. then, the, map; f : i: — > E defined by 
£((t)' = A.(t:);(x (t.) ) is-. analytic?at' O. . 

Proof. Let A(t) — L‘A t!' andcx(t) =- Z X t*'. Let t^> 0 
n no 

be such: that, both' A (t^.) and^ XCt^). converge absolutely. Then 

f(t) = A(t)(x(t)) = (E A„t*")(L X^t*") = EA X = 

n " m: " m,n 

® k ^ 

E t E. A ,X.. Then by Theorem 4, f(to) converges, and 
k=0 j=0 ^ 

so f(t) converges absolutely for |t| < Iq. Hence f(t) 
is analytic. 

Keeping this concept of products in mind, we turn now 
to the question of differential equations involving functions 
from the reals into Banach spaces. Let I be an open interval 
containing O and let U be an open set in the Banach space B. 
Then, a function f:; IL x U — > Blis said to be a time-dependent 
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vector field on U. A map a: I — > U is an Integral curve 
for f if a is differentiable and satisfies the equation 
a' (t) = f(t,a(t)). f is said to be Lipschitz at t € I 
if -there is a constant K > O such _jfchat l|fXt,.x) -f(t,g)|| < 

K||x-y|| for all x,y in U. f is said to be uniformly 

‘ t 

Lipschitz ^ I. if there is a single constant K > 0, such 
that |lf(t,x) - f(t,y)|| < K|Ix-y|l for all x,y €. U and all 
t € I. - We let C^(I x U) denote the set of all functions- 
from I X U into B which are p times continuously differen- 
tiable. Let B^(Xq) = Cy € B: ||y-XQ!| < a]. Now we. can 
state an existence theorem for certain differential 
equations in Banach spaces. 

Theorem 5 . Let I, U, and B ^ ^ above .. Let Xq€- U... Let' 
a € (0,1) ^ a number such that ^2a^^0^ ^ U.. Let 
f : I X U — > B continuous . bounded ^ C,. and satisfy a . 

Lipschitz condition ( with constant K) uniformly with 
respect I . b < a/C and b < 1/K, then there is ^ 

unique integral curve a: (-b,b) x B^(Xq) — > U such that 
a(0) = Xq. f € (I X U), so a. 

In particular, we note that if f is continuously differentiable, 
it is continuous and satisfies a uniform Lipschitz condition. 
For a proof of Theorem 5, see Lang [6], | 

Let us see how to apply this theorem to stochastic: 
differential equations. In particular.,, consider the. equation 
X'(t) + A(t)X(t) = F(t), X(.0) = Xq,. where ACt)' and;: F(t) 
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are second order random functions and Xq is a given second 

order random variable. Solving the above equation for 

X'(t), we -have X'(t) = F(t) - A(t)X(t), and so the vector 
2 

-field (on L (Cl)) associated with _this eqjaajtion is given by 
f(t,x) - F(t) - A(t)x, To insure that the formal product 
A(t)x is well defined for every t € I and every x €L (fO, 
we assume that there is a constant K > O such that 
ess^ |,up 1 A( t , oc 1 < K for all t€I. We will show that for 

each t, A(t) can be thought of as a bounded linear operator 
2 

on L (fi) , whereupon the formal product A(t)x will be a 

2 

product as defined earlier; in particular^ A(t)x t L. Cft) 

2 

for every t ^ I and every x € L (fi), and so th.e function 

2 

f(t,x) is a well defined vector field on L 

Suppose then that ess sup |A(t, ui) 1 < K. Consider the map 

CO 

A; I — > L(L^(n), L^(n)) defined by (A(t)x) (aO = A(t,.co)x(ui) . ' 

We show first that for a fixed t€I, A (t) € L(L^ (fJ) , ( TO ) . 

2 

Thus we must show that if x € L (fl), then A(tTx must be a 

square integrable random variable on H. We have 

J [A(t)x]^(u;)d^(cc) = jA^(t, ui)x^(u:)d/i(co) < 

Ci ft 

ess ^^up |A^(t,cii)l ^ ( ui)d^(a;) < K^|lx|j^ < ®. Thus 

2 

A(t)x 6 L (ft). For a fixed t, A(t) is clearly linear, and 

I 

moreover ' 

i 

1/2 

||XrtTxi:= TArtTx)^(w)dM(w)) < (K^||x||^)^^^= K||xJ|.. 

Hence A (t) is a bounded operator and ||A (t) || < K. This 
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X'(t) + A(t)X(t) = I (t^/k! ) [X. E (^)A.X. .]. 

k=0 ^ ^ 1=0 ^ 


equals F(t), so by equating coefficients (Theorem 


= V 


But this 
1) , we 


We are given Xq, so this formula allows, usr to: determine 
each X^ by induction. Now we have to show that the-- power 
series for X(t) with these coefficients converges (absolutely) 
in some neighborhood of the origin. 

We observe that the. expression, for X^^ can be' putt in. a: 

more convenient form.. We claim that. 


X = 
n 


^n^O 


n-I 

Z 

k=Q 


k^n 


where is the coefficient of Xq in the original expression 

for X^ (after successively substituting the. .previously, 

calculated X.'s, j < n-1) and ,f is the coefficient of F, 
j — k n k 

in the original expression for X . x and. , f are defined 

n n k n 

inductively *by the relations 


n 


Xq- 1, 


X ,= - Z (^)A.x . 


. f = O for n C k. 
k a — 

k^k^l- I’ X*"-J 


1 

1 


for n > k . 
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Notice that the expressions for x and , f are combinations 

n K n 

of the. A j ' s only; the initial condition and the forcing 
function E(t) are not involved in these coefficients. 

Proof of claim; We use induction on n. The claim 
clearly holds for n = 1. Suppose the claim holds for k < n 
and. examine the case k = n+1. 

n n n-j-1 

X. ,-== E- - I (“)A.X .= F' - E ('^)[ r .f . F. + .X., 

n^l n j j n-j n: j k n-j k n-j 0 

' n n-j-1 n 

- E - E. E (")A . , f . F" - E (”)A . = 

" j=0. k=0 J J ^ ^ 3=0 ^ J ° 

n-: n n-j-1 

((- E. (*^)A X )X + F -E.: E (”) A f F 

j 7 =Q: 1 J J ^ jr©^ k=0 ^ J K n J k 


n 


But — E (?)A.x . = X ,, so all that remains is to show 

j=0 J 


ni n~j-I 


F - I, E. (‘^)A. ,f . T" = E.,f ,, F. . 
j=0 k=0 ^ ^ ^ k=0^ ^ 


n 


Fix an integer p such that O < p < n'. What is the coefficient 
of F in the left hand side of the above equation? Notice 
that k = p only when j satisfies n-j-1 >.p, » 

j <, n-p-1.. Thus we get an F^ foi;^ j = 0, 1 , . . . , n-p-1 and k = p. 


Hence the complete contribution involving F^ is 


n-p-1 


-Fp r (^)Aj p^n-j- p^k° ° P so if p > n-j 

j. © 


we have „f .=0. Since p > n-j for j > n-p, we have 
R n-j ^ — ’ 
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n-p-1 

r ( )A. f 

j=0 P 


n-p-1 n 

- r (”)A. f .- r ( )A. f 

J J P j = n- p J 3 P ti-3 


n n n-j-I 

= - I (")A. .= . Hence F - Z E ( )A . ,f . F' 

j^O J P n-j p n+1 n j j k n-j, k 

n 

-- T , f , T F, and the induction, is. complete. 

, „ k n+1 k 

k=0 


As a consequence of the above, rela tionships.^ , wei have: 


n-1 

X(t) = L(t^/n:)X^ = r(t“/n!)[Xj^X + 21 j^f = 

n k=0*^ 

n.-I 

= X_ ECx^/nDt*^ +^ Ht^/n.’.') t T Fj,)'* We. w til: now 

On" a k-ff " ■' 

place additional restrictions on. A.Ct.). so,'^ that, we: can. prove: 

the above power series converge. 

Let A(t) = LCA^/a'.) t^„ and suppose- ther_e- is: some- con.-r“ • 

stant K such that ess sup. 1 a Co;) I < k” for: each n". . Then 

each A^(u)) can be thought of as a bounded linear operator. 

on L^(C), i.e., A^€ L(L^(fl), L^(r*)). Also ess^up jA(s, oi j < K’ < ® 

for some K' and for all s in some neighborhood of 0, and so 

our original restriction on A(s, w) (allowing us to form 

products) is satisfied. We wish* to show that. A(s) = ECA^^/n.' )s*^ 

2 2 ~ 

is an analytic map from I into the Banach space L(L (fl), L (H)). 

First we need to calculate the norm of A considered as an 

n 

2 2 

element of L(L (fJ), L (fi)), and we have the- following- theorem. 
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Theorem 6 . Let ' A; T' — R at random variable such that 

ess sup 1 a(u,') 1 < Then the norm of A considered as an 
' 2 2 

element of. L (L (ft) , L ( tt) ) is ess sup [ A ( cc) \, 

Proof : Let ||A!j denote the norm of the linear operator 

genera.ted by A. Then ||Aji =- sup ||Ax||. Let x:fi — R 

l|x||=l. 

. / 

be, such that' jjx}| ==- 1.. Then' 

|1Ax]| (^(Ax)^(o;)d;i.(a3) ( jA^ ( oj)x^ ( to)d (ess^^sup A^(oi) 

x^ Ca')dM( a,') = ess^sup; }A(oi>.l l|xli = ess , sup 1 a(o:)1. , 

H'enc'e- llAji Cess=.,sup‘: lA-(oi)l.. We-.show now that 1 |a 1| > ess sup lA(ui)|. 

Eff;t c: > O; be: given. Let:K ==ess:sup 1 a(o:) 1 and define the 

s.et D. = {u;,:lA(a}) | — f}. We '.may suppose without loss of ! 

- 1/2 ■■ 

generality that. ji(D), =- 6 X O'. Define x(ui) = ’ 

where "■ 1- for:' . DI andc x( w) ~ 0 otherwise. Then ( 

j' 

I 

llxji = x^(w)dM.(w)-)^'^^ -(J 6~^d/i(a)J)^^^ = (m(D) 6"^ ) 1, li 

r: d; ii 

li 

and 1 |Ax11 = (J A^(cc)x^(aj)d^(ud.)^'^^ = (6 ^ J A^ ( cc)d;i( u)) ) > 

ft D ’ 

> C6”^(K— c)^;i(D))^'^^ = K-c. Hence |1 a 1| > K-e, and since e 
is arbitrary, we see that Ha|! > K. Thus l(A|i = ess^sup lA(ui)|. 

QED 

n' 

We: now see that. E(A^/n.’ ) t ' is a power series in j 

L.(L^(.ft),. L^(0)) s-ince: EdlA.jj It^'j/n:) = 



f 
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E (ess^^sup IAj^Co;) 1 Itl’^/a.') < L (k" jtl“/n.') = 

Hence A(t) - E(A t'^/n') is analytic in L(L^(fl),- L^(f5)). 

t 

Form the function y(t) = -J A(s)ds where integration takes 
2 2 

place in L(L (ft), L (ft)), and then consider the bounded 
linear operator (for each t) exp y(t). This is an analytic, 
map, and simple algebra and an inductive proof shows that, 
its power series has the coefficients defined, previously. 

, Hence applying the corollary to Theorem 4,. the function 

2 ? 

X„ exp (- ! A(s)ds) is an analytic map from I into L ’(ft) 

"o 

Now consider the expression: 

t t V 

exp (-J A(s)ds) J exp (J A(s)ds) F(y)dy where the: indicated: 
0 0 0 


Integrations involving the exponentials take place^ in 
2 2 

L(L (ft), L (ft)) and the remaining integration takes placre:- 

2 2 ' 
in L (ft). Since F(y) is analytic (in L (ft)), 

2 

exp (j A(s)ds) F(y) is analytic (in L (ft)) as before, and 

O t - 

consequently so is its integral J ; we apply once more 

t O 

the operator exp (-J A(s)ds), so the whole expression defines 

O 

2 

an analytic function in L (ft). Ap;ain an inductive proof 


shows that the coefficients of this analytic map are 
n-1 

E . f F. as previously defined. Hence our power series 
k=o 

for X(t) converges (absolutely) in some neighborhood of O', 
and analyticity is established. We summarize our resulta' 
with the following theorem. 
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Theorem 7 . Let F(t) and A(t) = E(A^(u;) /n! ) analytic 

second order random functions and let Xq ^ ^ square 
Integrable random variable . Suppose there is a constant K 
such that ess_sup lA^.(ai) ] < K*' for every n. Then the 
sitochastic differential equation X'(t) +A(t)X(t) = 

K(t) , X(0) == Xq has a unique analytic solution . 


Note that . the ; extension of this theorem to higher 

or.der. equations is trivial. If we have the equation 

X^"^^^(t) (t) +•••+ a_(t)X(t) = F(t) and the 

n- 1 . O 


cr»:efTlcients - are , analytic 

ri“ X 

fxxrr some; se t . [K . ] land 

J <3 . 

in" ax vector , f orm~ 


and satisfy esssup (O ) \ < 

u. j j 

every k, then we write the equation 


X' (t) = A(t)X(t) + G(t) 


where. 


,01 O ... 

O O 1 0 . . . 


O 

O 


and G(t) 


A(t) = 


0 0 0 
-aQ(t)-aj^(t) 


F*(t^ 


1 


Note. that analyticity of the aj(t)'s Implies that of 

2 n 

A-(t.) (as a. bounded, linear operator on (L (SD)") and G(t) 
is obviously analytic. Hence the same techniques of our 
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theorem extend to this case and to the state. space equations 

of stochastic control theory, in particular to the recent 

work of Leon H. Sibul (dissertation).^ 

Turning to the question of; stati.onari.ty , we are interested 

in finding necessary and sufficient condi.tions that an 

analytic random function be. stationary. We. will, assume all 

-our random functions satisfy < X(t) > =-0. Suppose' then 

that X(t) = E(X /n!')t*' is a real- analytic: random function 

n. 

with the (analytic) covariance function F(s-, t). Suppose 
also that X(t) is stationary. Then there; is some.-function 
f:R — > R such that r(s,t) ^ i(t.-s;).. Note; that.f(u) = f (-u) . 
Since r(&,0) = f (-sO ,, we see that: f; is- analytic; (at O), 

so there are real numbers: c s.uch. thai: f:(s) =‘--]L;(c ' / n.' )s^. 

n' n.“ 

Let us see how these constants; are:- related- to: X(t) . We have 


r(s,t)=< X(a),X,(t) > ==<: IKs^X /ml) UA/nl.> = 


m: 


ra 


nr. 


a 


= L L (s'^t" -^/j: (n-j;): ) <-X.X;, >' = 

n=0 j=0 J " J 


n 


I d/n.’) L C..)s'^t 




n=0 


j=0 


J 


<- X .X >. 

n-J J 


But’ 


n 


f(s-t) = L (c (s-t)"/n.’)= L d/n.’) L (-l)"“jc ('J)s-^t^"j 
n=0 " n=0 j=0 " -J 

Since f(s-t) = F(s,t), we have these two power series (in 

« 

two variables) representing the- same function, hence their 

coefficients must be equal, thus (-1)*^ “^0 = < X . X.>. 

n n-j J 


Rewriting this last equation, we have. < XX >= (-1) c . 

M . n m n+m 


Sibul. L. E.. ,. App.Ilca.tion . of. Linear. Stochastic 
Opera tor Theory ,. Pennsylvania. State University disser-- 
tation, 1968. 


/ 
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On the other hand, suppose we have a zero mean analytic 

random function X(t) = Z(X^t^/n.'.) such that” there . exist 

constaats [c satisfying < X X > =- (— l.)“c . . Then 
n n m' n+m 

the above equations show that X(t) is' stationary. Thus we 
have the following' theorem. 

Theorem 8 . Let X(t) = L(X^t^/n! ) be' a- ( zero ' mean ) real 

analytic random function . Then X(t) is . stationary if and 

only if there are constants (c } such that < X X > = (-l)^c 
— n n m' n+m 


It is clear that, a set of'! constants (c^J satisfying 
the condition, of. Theorem 8- cannot-: bei comp.letely arbitrary. 
In fact,, we mus.t have. = 

i)) ®2k+l"' ‘^4k+2 — 


2k+l. 


To see i) , note that C (r-i:) ^2k.+l!:" ~'^2k+l 


. 0 . 


and < ^QX2k+l ^ ” ('“D ^2k+I' Since X(t) is real-valued, 


we have -Cm. .-i= Cr,,. . n , i.e., c„,_ .,= O. This is5: to be ex- 


'2k+l ^2k+l’ - -- 


'2k+l 


pected since f(t) must. be. an even function. Also 

9 9ir 9 

0<<x^^> ^ <X^^X 2 ^> = (-1) ^c^j^ ^c^j^ and 0< = 


< X 


2k+l ^2k+l^ = hence ii.) and iii) are 


proved. By defining d^= we can write f(t) in the 


'2n 


form f(t) = Z (-1) ^(d^/t2n)I ) t^*' where, d. > O.for all n, hence 
n=0 

fCt) is representable by an even,, alternating power, series . 


(Note that d = <X >) . 

n n. 
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Theorem 8 can be reformulated in the following way. 


Theorem 9 . Let X(t) = L(X^t^/n.') ^ a ( zero mean ) real 
analytic random function . Let A = [Xq,X 2 , • • • >^2n’ • ' • ^ 
and B. = (X^^, X^, • • ■ , ^2n+l’ • • * Then X(t) stationary 


if: and only if A orthogonal to B and 

^2h+l’'l^ * ’'2(n-k)+1^2k+l ^ 


k = O, . . . , n 
k = 0, . . . , n 


and' 


iii) <X 2 ^Xq> = “< X 2 j^_j^Xj^ > for all n > 1. 


K*oof : Suppose X(t) is stationary. We show that AJLB 

first;. < X2jjX2j^^3^ > = (- 1 ) C2j^^2k+l" ^2(n+k)+l" *^®^ce 


A^'B: . Also, 
1) <X 


2(n-k)^2k^ ^ ^^2n-2k+2k ^2n ^^2n^0^ 


^ ^2(n-k).+l ^2k+l^ ^ ^ ^2n-2k+l+2k+l‘ 

~^2n+2 " ^2n+l+l" ^ ^2n+l^l ^ 


<X2n-A .> = = -^^20 = ”< Wo >’ 


so the first half of the theorem is proved. 

Suppos,e now the second half of the theorem holds. 

Define (c^} by the equations C2m+1^ ^ m = 0,l,..., and 

Co = < Xo X^ > m = 0, 1 We will show that <X .X.> = 

2m 2m O n-j j 

i 

=- (-1) f or 0 5. j < n a^nd all n, whereupon Theorem 8 
tells US' that X(t) is stationary. Suppose first that n 
isroddi. If:j isieven, n-j is odd and X^^_j c B, hence 
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<rx .X . > = O since X . € A. Thus < X .X . > = 0 = <-!)”“ 
n-j J J n-j j n 

since n = 2m+l for some m. If j is odd, n-j is even, so 

X . t A and X.€ B, hence <X .X . > = O = (“l)^"''^c as before. 
n-J J ’ n-J J n 

Now we show Theorem 8 is satisfied for even n. Let n = 2p. 

Firs t. consider the case where j is odd, let j = 2q+l, 

Then 

-■< %(p,-l) + lh=' - <='2p-lh> " -< - 

2p_- n 

Nowa su P ilose, j is- even ' j . = 2q . Then 


«X, .X. »==<Xor„ = <Xo X-> Co^ 

n^j. J. 2.(p-q) 2q 2p 0 2p 


=..(_-i)2(p-q)c2p= (-1)""J< 


n 


as- was= to be shown. Hence X(t) is stationary. QED 

We now have developed a technique for finding the power 
series coefficients of solutions to stochastic differential 
equations and- we. also have theorems which tell us when a 
given analytic stochastic process is stationary, so in 
principle we have. the machinery to determine conditions 
under which a given equation will have stationary solutions. 

i 

We present some examples to show how this may be done. 


Example 1. . We know that the derivative of a stationary 
random' func lion , is^- stationary . When will the integral of 
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a stationary (analytic) random function be stationary? 

This question is equivalent to determining stationary 
solutions to the differential equation X’ (t) = F(t), 

X(0) -= Xq where F(t) is the gi\r^n stationary (analytic) 
random function and the random variable X^ yet to be 

specified. The soltuion to this equation is 

t 2 “ 

X(t) - X. + r F(s)ds - X„ + F.t + F.t /2; +... . r (X t /n.') 
° O 0 0 1 „=0 " 

where X = F , for n > 1. 
n n-1 — 

We now apply Theorems 8 and 9 to this random function 

to see what additional conditions we need to place on X^ 

to guarantee stationarity . Theorem 9 tells us that in 

order for X(t) to be stationary, it is necessary that 

<X„„X,~> = (-1)*^ <X^>, i.e., we must have <F„„,,X_> = 

2n0 n — — 2n+10 

- ■=>^2(„^l)’'o'' ■ Hence 


our first restriction on Xq is that it must satisfy the 

relations <F.,„.,X„> = (-1) < F^> . Moreover, Theorem 9 

requires that < ^o^2n+l^ ^ hence our second 

requirement is that ^Q^2n^ ^ Since F(t) 

is stationary, there are constants such that ^ 

, <F^_.Fj> =' (-1)” Define constants ic^^} by the 

2 

relations O, Cq= < >, and “^2n‘ will 


show that <X^_jXj> = (-l)""^c^. 


Case 1. Let n be odd, n = 2k+l. We must show 

<X _.X.> = O for all appropriate j. For j = 0, <X _^X.> 
^ J J ^ J J 

- <^-iV • J i ^ VjV ■ 


{ 
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= <F„ . ,F. ,> - (-1)” ^ „= (-1)” ^ .= O since 

n-j-1 j-1 n-2 2k-l 

the f 's with odd subscripts must be zero, 
n 


Case 2. Let n be even, n = 2k. For j = 0, <X .-X .> = 

’ n-j j 


<W “ <ViV ' <’'2k-iV " <J'2(k-i)+iV - 




,2k 


= (-l)'^c^ as required. For j > 1, < X^_ .X > = 


= (-l)""-^''f 2 (k-l) = <-l>""'"- 2 (k-l ).2 = (~l>'"‘Sk.= 

= (-1)^ ^c^ as required. Hence we see that necessary and.’ 
sufficient conditions for X(t) to be stationary are that, 
<F(t)> - 0, <F 2 „^iXj,> - (-1)"^^<f 2>, and <F 2 „Xq> - O:.. 


These last two conditions may be combined by requiring that, 
<XQF(t)> = <Xq I(F^t"/n.')> = KtVn.' ) < XqF^> = 

r(t^"'/(2n).')<XQF2^> + Z(t^"‘^V(2n+l):X XqF2j^^j^> = 

= L(t^"'*‘^/(2n+l) : ) (-1)"'^^<F^> = -E(t^'^'^’^/(2n+l):) k 

4 

X (-1)"<F^>, 

i..^. , we require that the correlation function of F(t) 
and Xq be given by 

<F(t)X_> = -E((-l)"t^”'^^/(2n+l):) <F^>. 

0 n 
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Example 2 . We present here an example of. a differential 
equation in which the coefficient function as well as the 
forcing- function, is random. Consider the equation 

X'(t) - Ae“^^X(t) = AB(e^^- 1) 

X(0) = B 

wtiere A is an essentially bounded r.v. Writing the equation 
in. the form. X’(t.) +“A(f)X(t) ="F(t), we:calculate that 
ACt) = -Ae EX— A) , A^== (-A)^^^. Also 

co: 

' we have F(t) = AB.(e'^^— 1.) = 21,A*^''^^Bt^/n.' so we have 

n=i: 

Qi and- E =- for.' n' >. 1', We-_ have ra' solution 

(u- n. — 

x((t):. - *her«-X- - +- - 

k=0. t 

k+-i n—l- . , 

= X B + E- .f (A*^^^B.) = B(X„+- E:. f„ = BC„ 

n k.i k n a, ^..^k n n 

where we. define to: be the:- expression in the brackets. 

Remember- tha.t bo-th. and- j^f:^. are. polynomials in the 

variables A^,,..,A ,, and since the variables A, are 

O n- L k 

k-hl 

polynomials in. A (A^= (-A) ),, we. conclude that is a 

polynomial in the r.v.. A. Now if.X(t) is to be stationary, 

2 

we must have ~ this condition becomes 

2 2 

<A B > = 0 and hence we know that any polynomial in A is 

orthogonal to any polynomial, in B'. Thus we have <X X > = 

n m 

2 

= <BC BC > = <B C C > = O for n + m > 1 and consequently 
n m n m — •' 

Theorem 8 is satisfied. Thus the solution is stationary 

Z 2 

if and only if <A B. > = O. Note that we did not actually 
have to calculate, the, solution . to raake^ this . conclusion. 
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Example 3 . Consider the equation X"(t) + BX(t) = O, 

X(0) = Xq, X’(0) = Xj^, where B is a random variable which 
is positive a.s. This equation is a stochastic analog of 
the harmonic oscillator equation^ Suppose X(t) = E(X^/n.' ) t”, 

then X”,(t) = E(X^^ 2 /‘^' ) so O = X"(t) + BX(t) = 

X o= “Bx for all n. It is easy to see that the; coefficients 
n+2 n 

X^ are given by the relations X 2 ^^= (-B)*b(Q and ^ 2 ^^^^^= (-B)^Xj^. 

The closed form expression with these coefficients is 
X(t) = Xq cos /B t + CXj//B) sin /B t. 


To see when this random function wiLl be sta'tionary , 
let us assume that the random variables B,. Xq,, and: X^^ are 
all independent and < X^> = < Xj^> = 0. We apply Theorem 9, 

so define A = [Xq, X 2 >X^, . . . } and C = [X^^jX^^Xg, ]. Now 

A and C are orthogonal since ^2n^2p+l^ ~ (-B) 'Vq(-B)^Xj^> = 

= < (-B)”^^> < Xq> < Xj> = O. We check the last three 
conditions of the theorem; 


<>‘2(n-k)=‘2k> ' < (-B)”-\(-B)%> - 


<(-B)"XqV - <!t2„V 

<>=2(n-kHAk^l> - < 

< (-B)'^X,X,> = <Xo_.-,X,> 


‘ 1^1 


2n+l“r 


< X2nXQ> = < = <(-B)“><Xq> - 

(-!)”< b"> < Xq> . 


iii) 


' 2 :-) 

Also (-1)'^"^ < > ■ 

Bui till - o expressions must bo ne^tn lives ' ' one ai;; 
and so s b'V < < X^>/< > . Let < < X^>/' 

then < b'V -- c < B^ ^>, i-e., < B*^> = c*^ for every llu; 

characteristic function for B is < exp itB> = 

r i^t*^ < B^>/n..' - r(itc)^/n.' = exp itc, so B = c a.s. 
since characteristic functions are unique. Thus if we 
assume B, X^, and X^, are independent and < X^> = < X^^> = 0, 
th.e solution is; stationary if and- only if 
B(ai) = <Xp>/<X^> a.s.. 

Threse' tJiree; examples serve, to: indicate a fairly 
wide range of. questions which thet techniques of this section 
can answer. The first example provides us with a criterion 
which, we will use in section 3 to: characterize the general 
form of stationary solutions to the. equation. Example 2 
shows that we may characterize conditions for the existence 
of stationary solutions without having to find the solution 
itself. Example 3 says that a more general canonical form 
of simple stationary processes (i.e. adding randomness in 
the time functions of A cos t + B sin t) is not needed. 
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SECTION 3 

In this section we use some of the tools of random 
harmonic analysis to develop further conditions guaranteeing 
stationarity of solutiohs to certain stochastic differential 
equations. We make extensive use of the harmonic decom- 
position theorems concerning stationary processes to find 
sufficient conditions to be placed on the Initial values 
of the equations. We then calculate the correlation 
function of the resulting solutions. Moreover, we show 
that under fairly general conditions we can get asymptotic 
stationarity independent of the initial values. We begin 
with the notion of an orthogonal random measure. 

Let B denote the family of Borel subsets of the real 
line and let (7 denote the subfamily of bounded Borel 
subsets. Then a function i:<7 x K — C is called an 
orthogonal random measure if 

i) t(A) € L^(ft) for each A € 

ii) E(4(A)) = O for each A € 

iii) E(C(A)1 TbT) = O if a B = 0, A,B 6 a 

2 

iv) the relation M(A) = E(1^(A)1 ) defines a measure 
on <7. I 

' J 

The measure M is called the absolute measure associated with 

If f;R — :> C is a complex valued measurable function 
^b 2 

such that J lf(X) 1 dM(X) < we can define the integral 
a . 
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J f-(X)4(dX) in a natural way (see Rozanov [8]). 
a 

We say that a second order r.f. rjCt) ,is separable 

2 

if the smallest closed linear manifold in L (Si) containing 
the r.v.'s separable, e. , it contains a 

I 

countable dense subset. We remark that a continuous r.f. 

r)(t) is necessarily separable, for let V be a basis for 

L-. (n) and let {t ] , denote the set of rational numbers. 

n n=l 

Then for. each n, there is a countable subset of ^ 


(call it H = } , ) such that ^(t ) = L E(? 7 (t )h )h 

n nm m=i n , n nm 

m=l 

L'et:H = la j , be an orthonormal basis for the smallest 
n n=l ^ 

oo 

cdbsed- linear manifold containing wH . We claim that 


nm 


n=l “ 

00 

for: every t, T}(t) = E E(T](t)a )a . This equation obviously 

n=l ” ^ 

holdsrif.t is rational, so we suppose that t is irrational 

and: f > 01 Since rj is continuous, there is a tj^ such that 

iiTjft) ---T](tj^)ii < There is an N such that if n > N, 

n 

then i;T 5 (t. ) - E E(Tj(t. )a )a |l < e/3. Hence, for n > N 
K , K m m 

m=l , 

n 

liT}(t) - E E(rj(t)a )a ,, < j|T}(t) - T)(t )|i + 
m=l mm- k 

n n n 

+ i|T](t^) - E E(T](tj^)a^)a^ii + ii E E(T)(t^)a^)a^- E E(T](t)a^)a 


m=l 


m=l 


m=l 


m m 


n 


<■ e/3.+ e/3 + ,1 E (E(T}(t.)a„) - E(T 7 (t)a ) ]a !'; < 

Km fM m 


m=l 


m m 


< 2 e/3 + iiT}(t. ) - t 7 (t)ii < c. 


Hence, the curve 7](t) is contained in a separable manifold 
a.nd so T)(t) is separable. 
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Rozanov proves that every separable stationary process 
(with measurable correlation function) is representable in 
• the form . 

V(t) = J 

—To 

where. ^ is an orthogonal random measure. (§ is called 
the spec tral random measure associated with 77 ) . This is one, 
of the most powerful results in random harmonic analysis 
and we will make extensive use of this theorem throughout 
the rest of the paper. Relevant discussions of these 
integrals and decompositions are presented in~ Rozanov’s' 
text [8] and in Irzhina's paper [5]. 

In particular, we are especially interested in; the 
equation 

( 1 ) X’(t) + aX(t) = F(t) 

X(0) = Xq - • 

2 ' 

where a is an essentially bounded r.v., X^ €- L (ft), and 
F(t) is a stationary continuous r.f. We will also suppose 
that a and F(t) are independent. As is well known, the 
solution to the above equation can be expressed as 

X(t) = X^e + e J e^^ F(y)dy. ' 

00 

We write F(y) = J e ^^^^C(dX) where ^ is the spectral 

— CO 

random measure associated with the process F(y). j Assume 

I 

for the moment that the following calculations are. valid and 

calculate f e^^F(y)dy = J e^^^^^C(dX)dy = 

"0 O 


^OD 
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- j" jV‘ 2 ”iX+a)^y 

— 00 0 — CD 

Thus 

X(t) = Xq 6"^S e’^^J ^e^^^^^^'^^^-^2ffiX+a)4(dX) 

- Xq 6~^^+ J ((e^^^^^-e"^V2ffiX+a)i(dX) 

( 2 ) 

-= e"^^[X - J (4(dxy2ffix+a) ] + J V27riX+a) i(dX) 

— 00 —CO 

= K(t,a,XQ,F) + Y(t) 

where K and Y are the respective summands from above. 

We show now that the random function Y(t) is a stationary 
process. 

E(Y(s)YTt7) = E(J'(e^"’^®V2ffiX+a)C(dX) • 

• f (e^’^^^^/2TTi^i+a) 4(d^) ) = 

= E(JJ(e^^^^®^"^^V(2TTiX+a) (2Trifi+a ) ) 4(dX)IT^) ) 

= j'jEa/(27TiX+a) (2tri^+a))e^’^^^®^"^^^E(e(dX)TTd^)) 

=. Je( 1/ l2ffiX+a l^)e^’^^^^®~^^G(dX) 

f ' f 

where G is the absolute spectral measure of F. As we 

see E(Y(s)V(t) ) is a function of t-s only, hence Y is 

i 

stationary and its correlation function is j 

f (t) -= Je( 1/ l2ffiX+a l^)e^^^^’’G(dX) . 


rf: F(t) is a real process and a is a real valued r.v., 
the above equations reduce to the representation 
X(t) = K(t) + Y(t) where 


Y(t) = J (a cos 2TrXt+2TrX sin 2TTXt/a^ + 4Tr^X^)u(dX) + 

O 

00 * 

+ J (a sin 2trXt - 27TXCOS 277Xt /a^+ 4ff X^)v(dX) 

0 

/ 

00 : 00 

where F(t) = J cos 2nXt u (dX) + J sin2ffXtv(dX) is the 
0 O 

-spectral representation of F.^ Also then E(Y(s)Y(t)) = 

car 

J E-(l/4rr^X +a^)cos-2ffX(s-t)G(dX) and Y(t) is again stationary 
O 

2 2 2 

with correlation function f (t) = J E(1/47T X +a )cos 2ffXTG(dX) . 

O 

We: get 

K(t) = e"^^[XQ— a-J(u(dX)/a^+4tr^X^) + J(2trX v (dX)/ a^+4ff^X^) 


and so if a(oj) >_x > 0 for. almost all w , we see that 

liun K(t,cc) = O a,e. and ..then X(t) is asymptotically stationary 
t'.“'“ 

(independent of the initial conditions). See also Adomian's 

discussion of a similar problem in his dissertation. 

We now need to investigate carefully the various 

integrations involved in the above calculations. In particular, 

* , 

the. problem may be phrased as follows: let I and J be 

2 

intervals, f:R x c measurable on the product space 

R X R X Tt, i B. random orthogonal measure; 1) can we define 


1 


See Doob [4] also. 
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the. integral Jf (x, y , oi) ^(dx) in a consistent way?, 2) if 
J 

so:,, when, can wer say that' the-interated integrals 

jJ f (x, y , 0.0 4(dx)dy, and jj f (x, y , a;)dy 4(dx) are equal? Let 
IJ JI 

us answer the first question. Let g:R x ft — C be a function 
with the property that there exists a mutually disjoint 
s:equenc:e:- of. bounded: Borel. sets. ^ sequence 


n 


L-(f}), such. that g(x, tc) = E C(Aj^,x)gj^( oj) 

k ~ 1 

where C(Aj^x) xsz the characteristic function of the set 

A'^.. Moreover we'r will , require, that the families {gj^ } and 

{{^‘(A^))} be. ij\dependent . . Then define Jg(x, oi) 4(dx) = 
n. 

IT gi- (’OJ) C ( A. , oD. . . We? get '. 
k--I: k. k. 

E.( I Jg.(x, co) 4(dx) 1^) =■--£;( I gjgj^ 4 (Aj) 4(A~) ) = 

j , k“l - 

((3). E.(gji^)E;(4(Aj)TO:“r) =- I E( Igj^l^)M(Aj^) 

j.'>k=*l.. ' k=l 


= Je.( lg(x) l^)M(dx) = Jljg(x)jl^M(dx), 


where M is the absolute spectral measure associated with 4- 
Now consider the set of all functions g(x,oi) = 2E(Aj^,x)gj^(oi) 

where (gj^) is independent of the' family - [4(A) ^ = all 

bounded Borel sets. is clearly a linear space, and if g € 

Jg(x)4(dx) is defined. Define i|gll^= ( Jl|g(x) |(^M(dx) 

then 11*11^ is a norm on Complete a/ with respect to this 
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norm and' denote the completed space S. If g € S and 

ji — ^ O, define Jg(x) ^(dx) as the limit in the mean 
of. the. random variables Jg^(x)4(dx). Note that equation (3) 
guarantees that this limit exists. Just as in the case 
of. ordinary stochastic integrals with respect to orthogonal 
random measures, we have that g(x) is integrable whenever 
J)lg:(x')ii M(dx) < “-and g is the limit of elements of Note 


that, if: g.; h. 6-S,- then E(Jg(x)C(dx) Jh(y)4(dy)) = 

== JcDv-(g(x) , h (x) )M(dx) since the corresponding relation 

hoids^ for elements . of Note also that if g(x) is continuous 

iir. meanr.square:-and independent of then g is 

|2 


integrable; if : and lonly if J||g(x)|l M(dx) < ®. 

Consider, now the question of interchanging the order 

of. iterated: integrals . Suppose we have a function 

o: 2 

fiR.-x fr. — >' C'which is measurable, f(x,y,*) € L (ft) for 

2 2 

each pair (x,y), and the natural map from R into L (ft) 
induced: by f is continuous. Suppose also that the family 
[f(x,y)}^j^ y)tR2 r.v.'s is independent of 

Let: i: and J be intervals. Then g(x) = |^f (x, y ) <(dy ) exists 


if: and- only if J||f(x,y)|| M(dy) We want to integrate 

g(x) over the interval J, and ||g(x)|| = (Je( |f (x,y) l^)M(dy) 

I 

so let iis require that f satisfy the condition 


(4) J(J E( If (x, y) |^)M(dy ) ) ^^^dx < ®. 

J I 

Then- the integral f (x, y ) ^(dy )dx exists. Now we want to 


; 


37 


insure that Ij f (x, y)dx4(djO exists, so we need to know 

ij 

2 1/2 

that j (E(lf(x,y)l )) dx < Note that independence is 

J 

preserved under this integration, so all we need to check is 

r\ 

that j E(lh(y)l )M(dy) < ® where h(y) = J f(x,y)dx. But 
I J 

E(jh(y)i^) = E jJ f (s,y)f (t,y)ds dt = E (f (s , y ) f ( t , y ^ ) ds dt, 

JJ > JJ , 

so.we require that f satisfy 

-(5) JJ‘J E (f (s , y ) f (t , y ) )ds dt M(dy) < 

IJJ 

Now if f satisfies (4) and (5), both the iterated integrals 
exist. Consider now a subclass of function integrable with 

respect to 4. We say that g 6 U if g € a/ and there is a sub- 

2 = 
set H - H(g) C L (ft) whose finite linear combinations are 

2 

dense in L (r.) (call such a set linearly d ense) with the 

property that E(g(x)4(A)h) = E(g(x) )E(4(A)h) for x € A, 

k i-O, h H(g). We sometimes write this relation as 

E(g (x) 4 (dx)h) = E(g(x) )E(4(dx)h) . If g is a simple function, 

then 

E(Jg(x)4(dx)h) = E(E gi^4(Aj^)h) = E E(gj^)E(4 (Aj^)h) = 

= J E(g(x) )Mj^ (dx) 

for h €H(g) where is the measure defined by M^(A) =E(4(A)h). 
Hence if g C U, we have E(J g(x)4(dx)h) = J E(g (x) )Mj^ (dx) for 
h€H(g). 

Return now to the consideration of our function f. We 
require now that the range of the function g:R — J defined 
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by [g(x) ] (y , a.') = f(x,y,aj) be contained in U. Then there 

2 

is a linearly dense subset H Cl L- (fi) such.' that if ,h€H 
then 



f (x, y)dx^(dy)h) = 
E.(f (x., y ) )dxMj^ (dy ) 


J (E(J f (x, y)dx) )M^(dy ) = 



E(f (x, y) )Mj^ (dy)dx = 


- J E(J f C'x., y) 4X'dy )h)dx = ir(JJ f (x, y) 4(dy)dxh) . 

j I jj: 


Since H is linearly dense and the: above, relation holds 
for all h € K, we conclude: that. 

(6> Jj £ Cx;,,y.):4,(dy')dx =- JJ f:(x; y)dx^ 4Xdy:) 


IJ 


J.I1 


under these conditions. 

To summarize these resuLts, wer have: the following 
theorem; 


Theorem 10 . Suppose f : R x R x fi — > C. is~ measurable and 

independent from the orthogonal random measure 4- Let M 

be the absolute measure associated wi th Let f (x , y , • ) 

be square integrable and continuous when considered as £ ' 

2 / ' 

mapping from R x R into L. (?*).. Suppose there linearly 

2 _ 
dense subset H o^ L (f^) such that E(f (x, y ) 4(dy )h) ^ 

E(f(x,y))E(4(dy)h) for h € H. 2^. the intervals I and J 

we have 

J 4j E( l£(x,,y) l^)M(d.y,) )^-^^dx.< 

J n 


( 4 ) 


00 : 
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(5) and JJJ E(f(x,y)f(t,y)ds dt M(dy) < ® 

IJJ 

then jj f (x, y ) ^(dy )dx = JJ f (x,y )dx 4- (dy) . 

U JI 

In our calculations involving the differential equation 
(1), the function f is defined by 

tCx.y.aJ = - e2’'i*y 


Suppose that K = ess^sup; la(oi)j and. a. is real, valued. Then 


relation (4) becomes 
t 


(j' E( If (.x,,y) |^)M.(dy ) )^'^^dx: =- J (J E(e^^^) M(dy ) ) dx 
O — “ 01 — 


tr: 


(( j" M!(dy ) K( e?^^ ) dx. 

- 00 . (J) 

But (} M(dy))^^^ = l|FtQ)|( <- «, and E'(e:^^^) < 


: e. soc 


J t 9a V 

E(e )dx < “ for t flni.te. Hence: (4) holds-. Consider 

0 


^2ax 

now relat ion (5) . 


|E(f(x,y)fTt7?))| < <, 


. K(s-^t) 

<. e 


® ^t t 

hence jJ } J E(f (s, y )f (t, y) )ds dt MCdy)] < 

-« 0 O . 

< 1|F(0)1!^ j j e^^^^'^^dudv < ® for t < ®. Since a is 
0 


independent of F, f is independent of 4 (being a Borel 
measurable function). Hence' the- only additional, requirement 
we. place on a and F is that there exist a linearly dense 


set H for which 
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E(e^^4(dy)h) = E(e^^)E( C(dy )h) , 

for then we have ' 

E(f (x, y ) 4(dy )h) = E(e^^^^^e^^C(dy)h) = 

- e^"*=^''E(e>'‘‘«(dy)h) - e2’'l='yE(ey^)E(t(dy)h)- 

= E(e^^^^^e^^)E(^(dy)h) = E(f (x, y ) )E( 4(dy)h) . 

Note that if a is not random, then all these conditions are 
trivially satisfied. 

So now we can decompose the solution X(t) = K(t) + Y(t) 
into the sum of a stationary Y(t) and (in general) non- 
stationary K(t), Thus if we set K(t) = O and solve for Xq, 
we obtain a sufficient condition for stationarity . In 
particular, if 

(7) Xq = J (l/2iriX+a)^(dX) 

then X(t) is stationary. Note that a new difficulty arises 
in this expression. Namely, if a = 0 (in general, if 
/i{o;a(tc) = O] > O) and 0 is in the point spectrum of F, then 
(7) is not defined. This does not contradict our exchange 
of integrations however, but it does say that we cannot 
split up the integral in equation (2). 

The condition in (7) may actually be a necessary 
condition for stationarity. For example, consider the 
equation X’ (t) + X(t) = f , f € L^(fi) . F(t) = f , so 4(S) = f 
if 0 € S and ^(S) = 0 otherwise. Hence the condition is 
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Xq = J(l/2TriX+l) 4(dX) = f and the resulting solution is 
X(t) = J(e^^^^V2iriX+l) 4(dX) = f. Note that F(t) is 
analytic, so solving by power series we get X(t) =f + (XQ-f)e 
^.e. , X^= (-I)^(Xq- f), n > 1. Calculating the covariance 

function of this process, we see that a sufficient condition 
that X(t) be stationary .is that <f^> = <fXQ> = '^Xq>. We 
show now that this is necessary. For if X(t) is stationary, 
<XqX 2 > ^ -<X^>. But <XqX 2 > = <Xq> - <fX^> and <X^> = 

<Xq> - 2<fXQ> + <fS. Also O = <XqX^> = <Xq> - <fX^>, i.e. , 

2 

<Xq> = <1Xq> and so we have 

O = <X^Xo> + <X?> = 2<X?> - 3<fX^> + <f^> = 

O z i u u * 

= 2<Xq> - 3<Xq> + <fS, i.e., <fS = <Xq>. 

2 2 

Hence <X^> = <fXQ> = <f > is a necessary and sufficient 

2 

condition that X(t) be stationary. But then <(XQ-f) > = 

= '^X^> ~ 2<fXQ> + <f^> = O and so f = Xq. Thus the condition 

Xq= j (l/2ffiX+l) 4(dX) is actually necessary. (Note that 
we have incidentally proved that if a and b are r.v.'s, 
then a + be”^ is stationary if and only if b = O). 

Of course the condition on X^ expressed by (7) is not 
always necessary for stationarity . Consider the following 
interesting exajnple. Let X'(t) = F(t) and suppose that 
F(t) is real valued and analytic and 0 is not in the spectrum 
of F(t). Then the sufficient condition we get on X^ is 



42 


where F(t) 


X = -J (l/2ffX)v(dX) 

^ O 

00 CO - 

J cos 2.TTtXu(dX) + J sin 2trtX v(dX). Note 
0 6 . 


that 


ECX^FCt) ) 


-J (sin 
0 


2TTtX/2trX)M(dX) in this case, 


If we calculate the coefficients in the power series 
expansion for F(tJ, we. g’et , 

CO 

E„- == (-i:)^T (2n\)u(dX) 

2n Jq 

OD. 

^2n+l= ("1-^J (2ffX)^'^'^^v(dX). 

,^n+x Q. 

cor. 

Hence tn g.eneral. we. haver <F.^> J (2irX) *^M(dX) . Thus 


applying, the? result: ol: exampie-i 1, we: have-: that a necessary 
and sufficient cojiditien: for.- X(t) to^be stationary is that 

<F ( t ) X q> =- -DC (-1.) (2h+l ) : ) <fS = 

= -r( (-1) (2n+.l) : ) J(2rX)^''M(dX) 

= -Z J(,-I)'^((2irtX)^”‘^^/(2n+l):2ffX)M(dX) 


= -j'Csin 2irtX/2irX)M(dX) . 


Thus we see that if X^ is any initial condition for which 

X(t)' is stationary, then the: projection of the r.v. Xq onto 

2 

the smallest closed linear manifold in L (St) containing 

CO 

the process F(t) (call it J) is the r.v. -J (v(dX)/2irX) . 

O 

Hence in the case of analyticity , a. necessary and sufficient 
condition, tha.t X(t) be:- Srta.tionary; is: that . 


I 
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X = Y - J (v(dX)/2TTX) 

^ O 

where Y is any r.v. orthogonal to 

In this section we have restricted ourselves to the 
case of an equation with a constant (r.v.) coefficient. 

This restriction was made purely to facilitate the various 
computations made in. the interchange:- of; order.- of . integrations . 
Examining the more general case (time-varying coefficients) 
the author has been unable to extract' a likely candidate 
for the stationary part of the general! solution. Neverthe- 
less, the idea of using random harmonicc analysis;' especially 
in conjunction with the analytic: method: of; section 2..appears 

c 

valid, and progress in; this direction; seems- likely in the 
future. 


SECTION 4 


In section 2 we presented a general method of determin- 
ing. when stochastic differential equations with random 
(analytic) coefficient processes, random (analytic) forcing 
function, and random initial conditions have stationary 
solutions. In section 3 we presented a method of applying 
random harmonic analysis to a simpler first order equation 
and::we also presented an extension of integration techniques 
allowing us. to use these more powerful tools. In this 
section we wish to relate our work to that done by others 
and:, to also make a few remarks concerning the abstract 
notion of . stochastic transformations. We also indicate some 
future. work. 

First let us relate our results to Adomian’s [1] 
results concerning stochastic Green’s functions transforming 
a- given statistical measure of an input process to the 
corresponding measure of the output process. Suppose we 
have. a stationary r.f. F(t) with spectral representation 

I 

F(t) = J t(dX). 

We: have defined the correlation function 

f.(t) - < F(s)F(s+t) > J e"^’^^^^M(dX) 
where M is the absolute measure associated with 4- if 


/ 
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M is absolutely continuous with respect to Lebesgue measure 
on the line, we call, the Radon-Nikodym derivative 

m(x) = dM/dX 

the spectral density of. the process F, i_.je. , we have 

£(t) = .J e“^’^^^^m(X)dX 

and ra(X) -J e?^^^^f(t)dt 

Now in. the equation, discussed . in section 3 

X:'((th-i-arX(t) =-F.(t), X(0) = Xq 

with. the;E. V.. c.o.eif.'icxent a:-, we;cali;F(t) the input process 
and: X.Ct). the. output, process-. Moreover, applying the results 
of section 2 we know that wecan have a stationary F(t) 
resulting in. a~ stationary. X(t). Now let 

F(t) = J e^^^^^^(dX) 

and X(t) = J e?’^^'‘^^i^'(dX) 

be the spectral representations of F and X respectively. 
Suppose also that F has the correlation function f and 
spectral density function m.. We calculated in section 2 
the correlation function x for X given by 

x,(t) - I E(17 |2ffiX+a l^)e~^’^^^^m(X)dX. 

Hence we inunediately recognize , that the spectral density of 
K must be given by 

n(X) = E(l/ j277iX+a l^)m(X) . 
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Now the Green's function transforming the spectral, density 
of an input into the spectral density of the output, is a. 
(perhaps generalized)' function H(t,u) such that 

n(t) = J H(t,u)m(u)du 

whereupon we see that H is given by 

(1) H(t,u) = 6(t-u)E(l/ l2ffiu+a 1^) 

Note that this form of the Green’s function is the same as 
Adomian's [l] if the r.v. a is a constant,, for then we. get. 

H(t,u) = 6(t-u) 1y(u) 1^ 

where Y(u) = l/(2ffiu+a).. 

Similarly, the stochastic Green's function. G(!t,.u) trans- 
forming the correlation function f into x by the relation. 

x(t) = J G(t,u>f (u)du 

can be expressed in terms of H by the relation 

G(t,u) = JJ T)d<Tdr 

and so applying (1) we get 

G(t,u) = J |2ffiT+a l^)dT. 

In both cases we see that these Green's functions are. ex- 
pressed in terms of the statistics of the coefficient in 
the stochastic - differential operator. 

Let us make a few remarks concerning the. idea of. a-- 
stochastic transformation (s.t.), a concept due to Adomian 
fl]. If X(t,oi), t € T, co€ fj, is a s.p., a stochastic trans- 


; 
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formation or stochastic operator T on X carries X into 
another process Z = T[x], and T. in general depends on t 
and to' € C' (where O' may not be identical.to.fi). Thus 
T includes all deterministic transformations as a special 
case and we usually deal with integral, operators, differential 
operators, partial differentiaL operators , etc . 

We wish now to indicate a general; framework in which 
these ideas can be precisely expressed.. In . general . there 
is a natural desire to, distinguish between an operation of 
the form 

(2) X:(.t,.to) == HXt:, u.)Y(u, toDdu- 

where the kernel H(t,u) is; a^ complex, valued, functibn and X 
and Y are r.f. 's and an operation of: the form" 

(3) X.et„w) = J H.(i:.,u.,.ai)Y.(u., uj)du- 

where the kernel H also depends on the stochastic variable 
oi The transformation expressed by. (2) in which the process 
Y is mapped into the process X. is. of ten called: a. deterministic 
transformation whereas (3) expresses an operation' which 
includes (2) and conforms more closely with our intuitive 

I 

notion of a stochastic transformation.. Indeed. (3) is the 
general form of a stochastic integral operator. Similarly 
an equation of the form 

(4) X(t,.oj) - aY(t:, tc) + bZ(t, ui). 

where a and b are complex constants and X,Y, and Z are r.f.'s 
is rightfully considered a deterministic mapping of the 


I 
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pair (Y,Z) into the process X. On the other hand, an 
equation 

(5) X(t,(xJ) = A(t, o:)Y(t, ui) +. B(t, oi)Z(t, oi) 

mapping the pair (Y,Z) into X is a ’’truly stochastic" 
operation. Also we need to consider maps of the form 
Y. — > X defined by 

(6) X(t, to) = Y(f (t), to) 

where.f:T — > T indicates a re-parameterization of the 
time ivariable. One wants to think of (6) as expressing 
a3.deterministic relationship whereas 

(7) X(t,to) = Y(f (t),«p(to)) 

where f:T — > T and fi would again be "truly 

stochastic". Bharucha-Reid 's [2] "random transformation" 
refers to a map 

(8) T: ft X R — R 

with the property that the function T(*,x) is a r.v. for 

\ 1 

each X € R and such a random transformation may induce a 
stochastic transformation defined by 

(9) X(t, oi) = T(t4Y(t, ai)) 

carrying Y into X. One would call such a transformation 
deterministic if the function T did not depend on the 
first coordinate of its argument. The examples of trans- 
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formations in the introduction, to this;- thesis indicate more 
different forms that a s. t. can take. 

We propose to examine- a function* space approach of 
representing a r.f. as a measure on a fixed collection of 
functions; then a change of measures on this function space 
will be identified as a stochastic transformation. In 
particular, lot XCt); be. a real-valued s% p. with parameter 
set T = (a,b).. Following the construction" outlined in 
Skorokhod [10], we let be the space of all functions 

x: (a,.b) — > R.. If. A is? a Bor el. set in:. R and t^S (a,b), 

( 

we let C. (A.) = [x; $:x(t,^). € A'.}.. A set -which is the 

to O- 

intersectioa of. a. finxitee number..’ of:? setss of : thecform C. (A) 

0 

is a cylindrical set . We. Lett E‘ be; the; minimal, o-algebra 
of subsets of $ generated" by a'Ll- cylindrical, sets . Now the 
measure ^ determined, on. F' by. the. relations* 
k 

(10) n( (A^)) = P(X(t^., uj) e A^, i = 1, . . . ,k) 

n=l ‘'n 

for all k, t . .. .., tj^ in (a,b) and all. Borel sets A^, . . . 
is called the measure ^ the function space corresponding 
to the process X(t) . Kolmogorov's theorem guarantees us 
that (10) defines a unique measure, on F.'. . 

Conversely, suppose that we have a measure p defined on 
F such that p($) = 1. Then. we. have a probability space 
(R,7, P) where R. = 4», ^ = E, and: P- = /x.and .so we can define a 
process X(t), t 6 (a,b) by the. relation 


X(t,ai) = X(t,x) = x(t) 
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We remark that X(t,*) is measurable, for let A be a Borel 
set. Then IwXCt.o;) S A} = [x:x(t) 6 A} and this: is. a- 
cylindrical set and so X(t,0 is measurable, e. , 

X(t) is a s.p. Note also that the function space measure 
corresponding to X is just 

Hence every process on (a,b) is associated with a 
measure on and conversely. Now let M be the. set. of: alll 
measures ^ on 4> such that ^(4>) = Then, any function 
f:D — > M where D C m could be called a stochastic trans- 
formation. More generally, a function f:D — >=’ M where. 

D C m” can be a stochastic transformation.. 

The above interpretation of a stochastic process/ as= 

a measure on an appropriate function space does not. in 

itself obviate any computational difficulties associated 

with the analysis of s.p.'s. However, we can: now use the?. 

full power of general measure theory to gain new Insight. 

For instance, the author is currently attempting to 

prove theorems answering the following questions: Let. F. 

be a stochastic transformation and let X(t) be a stationary 

(in some sense) process. Suppose that Y = F(x) is stationary 

(in the same sense). Let ^ and 'y be the measures associated 

with X and Y respectively. Let be the manifold in 
2 

L (n) generated by X. Let Z = Z(t) be the process obtained 
by projecting Y onto and let rj be the measure associated, 
with Z. Is V « p? Is Tj « p? If P = Uq + is the 
Lebesgue decomposition of v with respect to p,. does 
Tj = i/^? If not, , is T] « I'j or « rj? Theorems along 
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these lines would give information concerning stochastic 
transformations which, carry stationary processes into 
stationary processes. Also we naturally ask what effect 
on a measure associated with a s.p. is induced by a 
stochastic differential operator on the process. Also using 
our interpretation of s.t.'s in this way, perhaps we can 
discover measure- theoretic properties' of. "deterministic" 
transformations (equations (2), (4),. (6)) that distinguish 
- them from "truly stochastic" transformations ((3), (5), (7)) 
and thus allow us to give a more useful. and: precise inter- 
pretation of these; notions-.. 
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